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This study explored the extent that the Houston Independent School District’s (HISD) assistant principal 
leadership training program (AP1/AP2) facilitated reflective learning of the 2014-2015 cohorts. In addition, the 
evaluation examined the academic achievement of students in schools of API/AP2 cohort participants. 
Leadership training applied the ISLLC framework that focused on creating a shared vision within the 
community, a culture of student learning, efficient management, and ethics to prepare participants for roles as 
principals. A total of 79 HISD leaders were identified as API cohort participants and 66 leaders were AP2 
cohort participants. Eleven training sessions were provided to strengthen their practice as leaders, increase their 
instructional knowledge, skills, and strategies; and inform their future feedback with teachers in 24 skill areas. 
In general, all ISLLC standards were reflected by API/AP2 survey respondents in at least one of the training 
sessions, with data for monitoring and improvement, district curriculum implementation, and mentoring 
staff/modeling as the three most prevalent skill areas considered as benefits in their reflective learning. Gaps 
were noted in participants’ reflections of benefits in skill areas related to clean and safe schools, effective 
presentation skills, team leading and building, and technology. This may be related to these areas being 
emphasized in principal leadership training rather than API/AP2 training. Considering HISD’s focus on 
literacy, the majority of API and AP2 cohort schools made positive changes on the STAAR reading and English I 
EOC tests from 2014 to 2015. Recommendations are to continue to develop the program by strongly addressing 
all state and national educational standards to support assistant principal’s roles as leaders and their potential 
roles as principals in HISD. 

n.d.). HISD’s “grow your own’ leadership 
development process for emerging school leaders is 
emphasized in the program. Socratic-style leadership 
development seminars are embedded in the program 
to build foundations of educational theory and 
managerial skill development to meet the job 
requirements of an assistant principal in an HISD 
school. An adaptive challenge project that measures 
the assistant principal’s increased impact on student 


Background 


The Houston Independent School District’s (HISD) 
Assistant Principal Leadership program (AP1/AP2) 
offers a viable option for preparing new assistant 
principals and deans for the role of principal. The 
Assistant Principal Cohort One (AP1)_ includes 
leaders in the first year of the program, while the 
Assistant Principal Cohort Two (AP2) continues the 


development and preparation of leaders as second- 
year assistant principals. 

AP1/AP2 professional development is aligned to 
state and national standards, including — the 
Educational Leadership Policy Standards, Interstate 
School Leaders Licensure Consortium Standards 
(ISLLCS), Texas Standards for Principal 
Certification, and HISD's School Leadership 
Framework (Houston Independent School District, 


achievement is embedded in daily work. Evidence of 
the year-long practicum is captured in reflective 
summaries that are shared with the HISD Leadership 
Development Team and a mentor who is assigned to 
each program participant for continuous process 
improvement. 

To that end, this program evaluation explored the 
extent that the API/AP2 program enhanced 
participants’ experiences through reflective learning 
based on the ISLLC educational leadership standards. 


The evaluation also examined the reading 
achievement of students at schools of AP1 and AP2 
participants. Reading achievement is, particularly, 
important considering the current literacy initiative in 
the District. 


Review of the Literature 


Developing effective educational leaders has 
emerged as a critical component of improving school 
performance, particularly due to a national shortage 
of principals who are willing and able to take on 
daily demands of the job. The literature on leadership 
development indicates that schools nurture unique 
learning environments, cultures, and conditions, and 
should be reflected in school leadership programs. 
School leadership may be the most important factor 
in promoting these in-school processes and 
conditions (Lieberman, Falk, and Alexander, 1994; 
Louis, Marks, and Kruse, 1996). Attributes of 
quality school leadership training programs should 
reflect research-based strategies and be aligned to 
industry standards. 

Numerous research studies have shown that school 
leaders play a significant role in promoting student 
achievement (Waters, Marzano, and McNulty, 2003; 
Leithwood, Louis, Anderson, and Walstrom, 2004; 
Bellamy, Fulmer, Murphy, and Muth, 2007; Christie, 
Thompson, and Whitely, 2009). Moreover, growing 
efforts to reform educational systems have led to the 
development of policies that directly impact the role 
of leadership in public schools (Jennings, 2003). 
Accordingly, in an evolving school climate, 
educational policymakers maintain that improving 
teaching and learning must become the primary 
concern of educational leaders (Jennings, 2003). 
Consequently, school districts across the nation have 
assumed responsibility for training staff to lead 
schools in ever-changing student populations. 

Finding practical ways to appropriately assess and 
develop leaders can have an important impact on the 
quality of leadership and education in schools 
(Glasman and Heck, 1992; Thomas, Holdaway, and 
Ward, 2000; Goldring, Porter, Murphy, et al., 2009). 
Thus, evaluation of leadership programs can be 
valuable toward improving leadership practices, 
contributing toward best practices, and providing 
information for accountability (Reeves, 2005; Waters 
and Grubb, 2004). 


Methods 


Study Sample 
The study sample was the 2014-2015 API and 
AP2 cohorts. A list of cohort participants was 
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provided by administrative staff in the HISD 
Department of Leadership Development in fall 2014 
to the HISD Department of Research and 
Accountability. There were 79 participants in the 
AP1 cohort and 66 participants in the AP2 cohort. 
Demographic characteristics of the cohorts by 
gender, race/ethnicity, level, and current role in the 
district were extracted from the 2014-2015 Public 
Education Information Management System 
(PEIMS). Schools represented by cohort participants 
can be found in Appendix A. 


Measures 

Cohort participants were asked to reflect on their 
learning from professional development sessions 
(Appendix B) by writing “one or two take-aways” 
that informed their practice as a leader and that 
enhanced their instructional knowledge, skills, and 
strategies. They were also asked to address how the 
training session informed their future feedback with 
teachers. These reflective comments were coded 
based on the Standards and Performance Criteria for 
School-based Administrators rubric and skill areas 
using interobserver agreement among three program 
evaluators in the HISD Department of Research and 
Accountability. There were six standards and twenty- 
four skills areas used in the analysis (See Appendix 
C for the standards). Nvivo 10 was used to organize 
and further analyze the data. Combined results of 
AP1/AP2 cohort respondents are presented, 
considering that both cohorts attended the same 
professional development sessions and that they 
could not be differentiated in the data. 

To assess improvement in the academic 
performance of students at AP1 and AP2 schools, the 
combined English and Spanish STAAR grades 3-8 
reading and English I End-of-Course (EOC) results at 
the campus-level were aggregated by cohort. The 
percent of students who met Satisfactory Level II, 
phase-in I standard was used in the evaluation. The 
spring 2014 results were compared to the spring 2015 
results for first-time test takers. 


What was the profile of AP1 and AP2 cohorts 


during the 2014—2015 academic year? 


According to Table 1, the API cohort was 
moderately larger than the AP2 cohort (16.5%). Both 
AP1 and AP2 cohorts were predominately female 
(67.1% and 70.8%, respectively), and had higher 
percentages of African American participants 
compared to other race/ethnicity subgroups (38.0% 
and 32.3%). 

Higher proportions of elementary-level participants 
were represented in the API cohort (35.4%) than at 
other school levels. Comparatively, a slightly higher 


percentage of high-school level participants were 
found in the AP2 cohort (34.8%) than the elementary 
school (33.4%) and at other school-level cohorts. 
More participants had a role as assistant principal in 
the AP1 and AP2 cohorts than other roles (45.6% 
and 67.7%, respectively). 


What were reflective learning perceptions of AP1 


and AP2 cohort participants regarding school 
improvement? 


Qualitative analysis was conducted on_ the 
reflective comments of the 2014—2015 AP1 and AP2 
cohorts to capture their perceptions regarding how 
the educational leadership training sessions informed 
their practice as leaders; strengthened their 
instructional knowledge, skills, and strategies; and 
informed their future feedback with teachers. (See 
Table 2 and Appendix B for a list of the 11 training 
sessions.) Comments were coded based on skill area 
and the Standards and Performance Criteria for 
School-based Administrators rubric. The rubric is 
aligned to the ISLLC standards. The identity of 
respondents was anonymous; therefore, participation 
in a specific training session was not verifiable in the 
data. In addition, it was not known whether all cohort 
participants had the opportunity to attend a specific 
session; thus, the count and _ percentage of 
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Table 1: AP1/AP2 Demographic Characteristics, 2014-2015 


API (n=79) AP (n = 66) 
n % n % 
Gender 
Male 26 32.9 19 29.2 
Female 53 67.1 47 70.8 
Race/Ethnicity 
Afr. Am. 30 = 38.0 22 832.3 
Hispanic 27 = 34.2 20 30.8 
White 20 = 925.3 20 30.8 
Asian 1 13 4 6.1 
Two or More 1 13 
Level 
Elem. 28 35.4 22 33.3 
Elem./Middle 1 1.3 1 1.5 
Middle 25 31.6 1725.8 
Middle/High 5 6.3 2 3.0 
High 20 = 25.3 2334.8 
Central Office 0 0.0 1 1.5 
Role 
Asst. Prin. 36 = 45.6 45 67.7 
Instruct’! Prog Dir. 0 0.0 1 1.5 
Teacher Fac. 4 5.1 1 1.5 
Other 27. = 34.2 16 24.6 
Teacher 12 15.2 3 4.6 


respondents who attended the session and made 
comments in a skill area were not calculated. Table 2 
presents the skill area and the standard that was 
reflected in at least one of the participant’s comments 
following the training sessions. 

In general, the six standards were reflected by 
AP 1/AP2 respondents in at least one of the training 
sessions; however, four skill areas were not reflected 


Table 2: API and AP2 Cohort Reflections by Training Session based on Standards and Performance Criteria for School Based 


Administrators Rubric, 2014-2015 


Training Sessions’ 


Standards and Performance Criteria Skill Area 


W | W | Iv Vv VI VII | VHI IX x 


Change Management (Standard 1) 


xX xX Xx 


Clean and Safe School (Standard 3) 


Collaboration with Community (Standards 1, 4, 6) 


xX Xx Xx 


Communicate Effectively (Standards 1, 3, 4) 


Consensus Building and Negotiation (Standard 1) 


Core Values and Beliefs, Visions/Mission (Standard 1) 


Data for Monitoring & Improvement (Standards 1, 2, 3, 4, 6) 


Decision Making (Effective) (Standard 3) 


District Curriculum Implementation (Standards 2, 3) 


Fair and Equitable Treatment (Standards 2, 5) 


Finance and Budget (Standards 1, 3, 4, 6) 


Mentoring Staff, Modeling (Standards 1, 2) 


Presentation Skills (Effective) (Standards 3, 5) 


Professional Development (Standard 3) 


Professional Growth Process Feedback (Standards 4, 5) 


Safe and Supportive Learning Environment (Standard 2) 


Staff Documentation (Standards 3) 


Student Achievement (Plans) (Standards 1, 2) 


Teachers (Struggling and Underperforming) (Standards 2, 3, 4) 


Team Leading and Building (Standards 4, 6) 


| >< 


Technology Use (Standard 2) 


Testing (Coordination) (Standards 2, 3) 


Time Management (Effective) (Standards 3) 


Xx Xx 


Walkthroughs (Standards 1, 2, 3, 4) 


Xx Xx 


Total 


3 


2 [2 | 3 5 [5 7 4 5 8 | 10 


Note: Training Sessions - I = Linked Learning; II = Just Do It; If[ = Attendance Improvement; [TV = Phun with Fonics; V = Ideal ELL 
Classroom; VI = FACE — Student Achievement; VII = Closing the Achievement Gap- Dual Language is the Answer!; VIII = Tick, Tock: 
Don’t Count Every Hour in the Day, Make Every Hour in the Day Count; IX = To Spend or Not to Spend?; X = Coach Like a Knight; XI 


= Doing TADS Right! 


in their learning (clean and safe schools, presentation 
skills (effective), team leading and building, and 
technology use) (Table 2). Respondents who attended 
the Doing TADS Right! session provided comments 
that addressed learning in the most skill areas (n = 
10), which covered all of the six standards. The skill 
areas addressed in the Doing TADS Right! session 
were (1) change management; (2) communicate 
effectively; (3) consensus building and negotiation; 
(4) decision making (effective); (5) mentoring staff, 
modeling; (6) professional growth process feedback; 
(7) safe and supportive learning environment; (8) 
teachers (struggling and underperforming), and (9) 
team leading and building). 

In contrast, survey respondents reflected learning 
in the least number of skill areas for the Just Do It 
and the Attendance Improvement training sessions. 
Reflective learning comments for the Just Do It 
session were related to mentoring staff/modeling and 
professional development; whereas, the Attendance 
Improvement training session focused on data for 
monitoring and improvement as well as finance and 
budget. In addition, data for monitoring and 
improvement; district curriculum implementation; 
and mentoring staff/modeling were the three most 
prevalent skill areas that API/AP2 participants 
communicated reflective learning. 


What was the campus-level reading performance 


of AP1 and AP2 cohort schools? 


The academic performance at campuses of AP1 
and AP2 cohort participants was used to measure the 
impact of the program on_ students’ academic 
achievement at their schools. Figure I reflects the 
positive or negative change in the percent of students 
who met Satisfactory Level II, phase-in | standards 


100 + 


80 + 


40 + 
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™ Positive Change ™® Negative Change 


Figure 1: Percent of campuses of AP1/AP2 cohort participants 
with positive or negative change in percent met Satisfactory 
Level II, phase-in I standards from 2014 to 2015 on the 
combined STAAR grades 3-8 English and Spanish reading 
tests, first-time test takers (TEA-Pearson Student Data File, 
May 2015) 
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on the first administration of the STAAR reading test. 
The 2014 STAAR reading test results were compared 
to the 2015 reading results to detect changes. 
Combined grades 3—8 English or Spanish results are 
presented by cohort. 

As shown in Figure 1, the majority of API and 
AP2 campuses had a positive change in the percent of 
students who met Satisfactory from 2014 to 2015 
(58% and 55%, respectively). It is also evident that 
students at AP2 campuses had a slightly higher 
percentage of students who experienced a positive 
change in their reading test performance over the 
years tracked. 

Figure 2 depicts the percent of API and AP2 
campuses that had a positive or a negative change in 
the percent of students who met Satisfactory 
standards on the STAAR English I EOC exam from 
2014 to 2015. The majority of campuses in both 
cohorts had a positive change in English I. API 
cohort campuses had a moderately higher percent of 
campuses that had a positive change in STAAR EOC 
English I results compared to AP2 cohort campuses 
(71% vs. 60%, respectively). 


AP1 AP2 


™ Positive Change & Negative Change 


Figure 2: Percent of campuses of API and AP2 cohort 
participants with positive or negative change from 2014 to 
2015 on the English I End-of-Course, first-time test takers 
(TEA-Pearson Student Data File, May 2015) 


Discussion 


The Assistant Principal Leadership program 
(AP1/AP2) was designed to prepare leaders in HISD 
for the role of principal. The program was based on 
national and state educational leadership standards 
and HISD’s “grow your own” leadership 
development model. During the 2014-2015 academic 
year, cohort participants were exposed to 11 training 
sessions that focused on the standards. The trainings 
were designed to enhance participants’ practice as 
leaders; increase their instructional knowledge, skills, 


and strategies; while providing effective feedback to 
teachers. Reflection is a critical component of the 
program and was used to gather information about 
participants’ experiences in these areas. In addition, 
the reading performance of students at schools lead 
by API1/AP2 participants was analyzed under the 
assumption that exposure on the national and state 
educational leadership standards would strengthen 
participant’s school leadership skills (Van Meter & 
Murphy, 1997), and improve student achievement. 

This evaluation found that AP1 and AP2 cohort 
participants indicated reflections in each of the six 
educational leadership standards; however, four of 
the twenty-four skill areas were not reflected in their 
learning (clean and_ safe _ schools, effective 
presentation skills, team leading and building, and 
technology use). The lack of reflections in the four 
skill areas may be, partially, related to the fact that 
these skill areas are emphasized in leadership training 
for new principals rather than assistant principals. 
The study also found that the majority of AP1/AP2 
cohort schools achieved positive changes in their 
STAAR reading and English EOC I exam scores 
from spring 2014 to spring 2015. 

There were several limitations to the study. First, 
the identities of participants who attended trainings 
and provided reflections were not known. Therefore, 
reading performance of students at campuses, 
although analyzed, may not be directly linked to 
participation in trainings. In addition, the small 
sample and lack of statistical controls limits 
generalization of the findings beyond the study 
sample. 

Considering the evaluation findings, 
recommendations are to continue to expose 
participants to skills areas that are currently being 
addressed in the AP1/AP2 training, given that they 
are national and state standards. In addition, consider 
providing training in skill areas that were not as 
strong in participants’ reflections in order to 
strengthen their leadership abilities and to better 
prepare them for possible roles as principals in HISD. 
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Appendix A 
AP1 Schools 


ADVANCED VIRTUAL ACADEMY LONG MIDDLE 
BASTIAN EL MADING EL 
BLACKSHEAR EL MADISON HS 
BONHAM EL MARSHALL MIDDLE 
BRISCOE EL MCNAMARA EL 
BROOKLINE EL MILNE EL 

BURNET EL MORENO EL 
CHAVEZ HS NEFF ECC 
CORNELIUS EL NEFF EL 

EAST EARLY COLLEGE H S ORTIZ MIDDLE 
EASTWOOD ACADEMY PATTERSON EL 
FONDREN MIDDLE PECK EL 

FONVILLE MIDDLE PILGRIM ACADEMY 
FORESTBROOK PIN OAK MIDDLE 
FURR HS RAY DAILY EL 
GREGOR Y-LINCOLN ED CTR (6-8) REVERE MIDDLE 
HALPIN EARLY CHILDHOOD CTR SCARBOROUGH EL 


HAMILTON MIDDLE SCARBOROUGH H S 
HARTMAN MIDDLE SHARPSTOWN INTERNATIONAL SCHOOL 
HENDERSON J EL SHERMAN EL 
HENRY MIDDLE SUGAR GROVE ACADEMY 
HIGHLAND HTS EL THURGOOD MARSHALL EL 
HINES-CALDWELL VALLEY WEST EL 
HOUSTON MATH SCIENCE AND TECHNOLOGY 
CENTER WEST BRIAR MIDDLE 
JEFFERSON EL WESTSIDE H S 
JOHNSTON MIDDLE YATES HS 
YOUNG MEN'S COLLEGE PREPARATORY 
JORDAN HS ACADEMY 
YOUNG WOMEN'S COLLEGE PREP 
KEY MIDDLE ACADEMY 
LAMARHS 
LANIER MIDDLE 
LAW EL 


LEE HS 
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Appendix A (cont’d) 


AP2 Schools 
AUSTIN H S JACKSON MIDDLE 
BENAVIDEZ EL JONES HS 
BLACK MIDDLE LANIER MIDDLE 
BONHAM EL LEEHS 
BRAEBURN EL LONG MIDDLE 
BRIARGROVE EL LOVETT EL 
BURBANK MIDDLE MADISON HS 
BURRUS EL MCREYNOLDS MIDDLE 
CLIFTON MIDDLE NORTH HOUSTON EARLY COLLEGE H S 
CONDIT EL SANCHEZ EL 
CRESPO EL SHARPSTOWN INTERNATIONAL SCHOOL 
DE CHAUMES EL SHEARN EL 
DEADY MIDDLE STERLING HS 
DEANDA EL THE RUSK SCHOOL 
DEBAKEY H S FOR HEALTH PROF THOMPSON EL 
EDISON MIDDLE TWAIN EL 
ELMORE ES WASHINGTON B THS 
ENERGY INSTITUTE HS WELCH MIDDLE 
FONWOOD EL WEST BRIAR MIDDLE 
FORESTBROOK WESTBURY HS 
FRANKLIN EL WESTSIDE H S 
GORDON MANDARIN CHINESE SCHOOL 
HAMILTON MIDDLE 
HARTMAN MIDDLE 
HENDERSON J EL 
HENRY MIDDLE 
HILLIARD EL 
HOGG MIDDLE 
HORN EL 
HOUSTON ACADEMY FOR INTERNATIONAL 
STUDIES 
HOUSTON MATH SCIENCE AND TECHNOLOGY 
CENTER 


See CSO a 
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Appendix B 
2014-2015 AP1/AP2 Training Sessions 


Linked Learning 

Just Do It 

Attendance Improvement 

Phun with Fonics 

Ideal ELL Classroom 

FACE — Student Achievement 

Closing the Achievement Gap- Dual Language is the Answer! 
Tick, Tock: Don’t Count Every Hour in the Day, Make Every Hour in the Day Count 
To Spend or Not to Spend? 

. Coach Like a Knight 

. Doing TADS Right! 
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Appendix C 
ISLLC Standards 


Standard 1: Facilitating the development, articulation, implementation, and stewardship of a vision of 
learning that is shared and supported by the school community 


Standard 2: Advocating, nurturing, and sustaining a school culture and instructional program conducive to 
student learning and staff professional growth 


Standard 3: Ensuring management of the organization, operations, and resources for a safe, efficient, and 
effective learning environment 


Standard 4: Collaborating with families and community members, responding to diverse community 
interests and needs, and mobilizing community resources 


Standard 5: Acting with integrity, fairness, and in an ethical manner 


Standard 6: Understanding, responding to, and influencing the larger political, social, economic, legal, and 
cultural context 
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